-
Notifications
You must be signed in to change notification settings - Fork 12.7k
SvelteKit-based WebUI #14839
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
SvelteKit-based WebUI #14839
Conversation
Sets up a new SvelteKit project for the web UI with Storybook & ShadCN installed This includes adding base files, Storybook configuration, Prettier and ESLint configurations, a test setup, and basic styling with Tailwind CSS.
Adds a theme mode watcher to the web UI. This allows the UI to automatically switch between light and dark mode based on the user's system preferences.
Introduces a script for streamlined web UI development. This script simplifies the process of starting a development server with configurable options for model selection (local or Hugging Face), port number, and build execution. It improves the developer experience by automating setup and providing helpful usage instructions.
Changes the SvelteKit adapter to `@sveltejs/adapter-static`. This allows for generating static HTML files for improved performance and easier deployment to static hosting providers. Configures the adapter to output files to the `../public` directory and to use `index.html` as a fallback.
Implements a proof-of-concept SvelteKit application with core chat functionalities. This includes: - UI components for chat messages and input - A chat service for handling API requests - State management using Svelte reactivity
@@ -0,0 +1,38 @@ | |||
# sv |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Update README file
what is reason to change from react -> svelte? Would it be better just to improve UI with react? |
Stops polling for available slots when context errors occur during chat completion. This prevents unnecessary polling when the user's message is removed due to context issues.
A number of us are frustrated by some of the default webui settings (see #14041 and #14468) which we as llama.cpp webui runners cannot change without recompiling the webui code manually, a burden, and I see this PR continues to have hard-coded default settings. Would you mind integrating the changes from @woof-dog's #14468 into this Svelte PR? All it does is set default local storage settings if they're not already set yet, using the /props endpoint. I would do the integration on my own if I knew Svelte well enough. I know you are working for Hugging Face and probably have enough orders. But we have been ignored and it would be a huge UI win to allow us users to define default settings at runtime. Riding the change into this PR would give us UI freedom like a working paste shortcut back... Thank you. |
Enhances error handling in the chat service with user-friendly messages for various server errors and network issues. Implements loading and error splash screens to provide better UI feedback during server connection and error states, improving user experience. Gracefully degrades slots monitoring if the server does not support the slots endpoint, preventing application crashes.
Improves PDF processing by bundling the PDF.js worker inline.
Hey @mashdragon, thanks for tuning in :) it's already on our list of wanted features, and though it won't be included in this particular PR, it will be added in a near future. I will also add this to my personal prio list to take care of this sooner than later ;) |
Refactors the chat form to include a dropdown menu for selecting different file types to attach. Adds a new component for the file attachment action. Also prevents form submission when clicking on attachments.
508e78b
to
66dc816
Compare
66dc816
to
158ab08
Compare
@allozaur All right, that's great. Thank you very much for responding. |
Maybe it is time to create a separate repo for the WebUI? |
cce8c12
to
a7c6fca
Compare
a7c6fca
to
edd48eb
Compare
No description provided.